2026-09-30 16:12:48,162 [ 192935 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-09-30 16:12:48,162 [ 192935 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-09-30 16:12:48,162 [ 192935 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-09-30 16:12:48,162 [ 192935 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_ij56yx --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]' 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]' test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]' 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]' test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_file_schema_inference_cache/test.py::test 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]' 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]' test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio 'test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]' test_filesystem_cache/test.py::test_system_sync_filesystem_cache test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_http_native/test.py::test_http_native_returns_timezone test_intersecting_parts/test.py::test_intersect_parts_when_restart test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_log_family_s3/test.py::test_stripe_log_truncate test_logs_level/test.py::test_check_client_logs_level test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit test_merge_table_over_distributed/test.py::test_filtering test_merge_table_over_distributed/test.py::test_global_in test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists test_multi_access_storage_role_management/test.py::test_quotas test_multi_access_storage_role_management/test.py::test_role_from_different_storages test_multi_access_storage_role_management/test.py::test_roles test_multi_access_storage_role_management/test.py::test_settings_profiles test_multi_access_storage_role_management/test.py::test_users test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table -vvv" altinityinfra/integration-tests-runner:cf95077f4609 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: repeat-0.9.4, order-1.0.1, random-0.2, timeout-2.2.0, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_mask_sensitive_info/test.py::test_backup_table test_keeper_four_word_command/test.py::test_cmd_clrs test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] test_keeper_back_to_back/test.py::test_concurrent_watches test_log_family_s3/test.py::test_log_family_s3[Log] test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] test_merge_table_over_distributed/test.py::test_filtering test_multi_access_storage_role_management/test.py::test_quotas test_keeper_client/test.py::test_base_commands [gw9] [ 1%] PASSED test_merge_table_over_distributed/test.py::test_filtering test_merge_table_over_distributed/test.py::test_global_in [gw9] [ 2%] PASSED test_merge_table_over_distributed/test.py::test_global_in test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed [gw0] [ 3%] PASSED test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf [gw4] [ 4%] PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] [gw0] [ 5%] PASSED test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons [gw9] [ 6%] PASSED test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed [gw0] [ 7%] PASSED test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst [gw0] [ 8%] PASSED test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp [gw0] [ 9%] PASSED test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump [gw0] [ 10%] PASSED test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro [gw0] [ 11%] PASSED test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif [gw4] [ 12%] PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] test_filesystem_cache/test.py::test_custom_cached_disk [gw0] [ 13%] PASSED test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr [gw2] [ 14%] PASSED test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family [gw0] [ 15%] PASSED test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld [gw2] [ 16%] PASSED test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups [gw2] [ 17%] PASSED test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes [gw2] [ 18%] PASSED test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands [gw7] [ 19%] PASSED test_multi_access_storage_role_management/test.py::test_quotas test_multi_access_storage_role_management/test.py::test_role_from_different_storages [gw2] [ 20%] PASSED test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number [gw2] [ 21%] PASSED test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing [gw2] [ 22%] PASSED test_keeper_client/test.py::test_quoted_argument_parsing [gw0] [ 23%] PASSED test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok [gw0] [ 24%] PASSED test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_client/test.py::test_rm_with_version [gw2] [ 25%] PASSED test_keeper_client/test.py::test_rm_with_version [gw0] [ 26%] PASSED test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_client/test.py::test_rm_without_version [gw2] [ 27%] PASSED test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version [gw2] [ 28%] PASSED test_keeper_client/test.py::test_set_with_version [gw0] [ 29%] PASSED test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_client/test.py::test_set_without_version [gw2] [ 30%] PASSED test_keeper_client/test.py::test_set_without_version [gw0] [ 31%] PASSED test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc [gw0] [ 32%] PASSED test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp [gw0] [ 33%] PASSED test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs [gw0] [ 34%] PASSED test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_jbod_balancer/test.py::test_jbod_balanced_merge [gw0] [ 35%] PASSED test_keeper_four_word_command/test.py::test_cmd_ydld test_join_set_family_s3/test.py::test_join_s3 test_keeper_session/test.py::test_session_close_shutdown [gw5] [ 36%] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] [gw5] [ 37%] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree [gw7] [ 38%] PASSED test_multi_access_storage_role_management/test.py::test_role_from_different_storages test_multi_access_storage_role_management/test.py::test_roles [gw7] [ 39%] PASSED test_multi_access_storage_role_management/test.py::test_roles test_multi_access_storage_role_management/test.py::test_settings_profiles [gw4] [ 40%] PASSED test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges [gw5] [ 41%] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] [gw5] [ 42%] PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] [gw7] [ 43%] PASSED test_multi_access_storage_role_management/test.py::test_settings_profiles test_multi_access_storage_role_management/test.py::test_users [gw5] [ 44%] PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] [gw3] [ 45%] PASSED test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session [gw3] [ 46%] PASSED test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session [gw3] [ 47%] PASSED test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions [gw3] [ 48%] PASSED test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests [gw7] [ 49%] PASSED test_multi_access_storage_role_management/test.py::test_users test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_file_schema_inference_cache/test.py::test [gw3] [ 50%] PASSED test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes [gw3] [ 51%] PASSED test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands [gw3] [ 52%] PASSED test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats [gw3] [ 53%] PASSED test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers [gw4] [ 54%] PASSED test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio [gw4] [ 55%] PASSED test_filesystem_cache/test.py::test_keep_up_size_ratio test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] [gw3] [ 56%] PASSED test_keeper_back_to_back/test.py::test_watchers [gw0] [ 57%] PASSED test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout [gw0] [ 58%] PASSED test_keeper_session/test.py::test_session_timeout test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_keeper_mntr_pressure/test.py::test_aggressive_mntr [gw9] [ 59%] PASSED test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch [gw5] [ 60%] PASSED test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_http_native/test.py::test_http_native_returns_timezone [gw4] [ 61%] PASSED test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] test_filesystem_cache/test.py::test_system_sync_filesystem_cache [gw4] [ 62%] PASSED test_filesystem_cache/test.py::test_system_sync_filesystem_cache [gw1] [ 63%] PASSED test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command [gw1] [ 64%] PASSED test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user [gw1] [ 65%] PASSED test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database [gw1] [ 66%] PASSED test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary [gw1] [ 67%] PASSED test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table [gw0] [ 68%] PASSED test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts [gw7] [ 69%] PASSED test_file_schema_inference_cache/test.py::test test_intersecting_parts/test.py::test_intersect_parts_when_restart test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit [gw5] [ 70%] PASSED test_http_native/test.py::test_http_native_returns_timezone [gw9] [ 71%] PASSED test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch [gw1] [ 72%] PASSED test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size [gw1] [ 73%] PASSED test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster [gw1] [ 74%] PASSED test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call [gw1] [ 75%] PASSED test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions [gw8] [ 76%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream [gw7] [ 77%] PASSED test_intersecting_parts/test.py::test_intersect_parts_when_restart test_keeper_four_word_command/test_allow_list.py::test_allow_list [gw3] [ 78%] PASSED test_keeper_mntr_pressure/test.py::test_aggressive_mntr [gw4] [ 79%] PASSED test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command [gw0] [ 80%] PASSED test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit test_keeper_nodes_move/test.py::test_node_move test_logs_level/test.py::test_check_client_logs_level test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists [gw1] [ 81%] PASSED test_mask_sensitive_info/test.py::test_table_functions [gw9] [ 82%] PASSED test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit [gw9] [ 83%] PASSED test_memory_limit_observer/test.py::test_observe_memory_limit [gw7] [ 84%] PASSED test_keeper_four_word_command/test_allow_list.py::test_allow_list [gw5] [ 85%] PASSED test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path [gw6] [ 86%] ERROR test_log_family_s3/test.py::test_log_family_s3[Log] test_log_family_s3/test.py::test_log_family_s3[StripeLog] [gw6] [ 87%] ERROR test_log_family_s3/test.py::test_log_family_s3[StripeLog] test_log_family_s3/test.py::test_log_family_s3[TinyLog] [gw6] [ 88%] ERROR test_log_family_s3/test.py::test_log_family_s3[TinyLog] test_log_family_s3/test.py::test_stripe_log_truncate [gw6] [ 89%] ERROR test_log_family_s3/test.py::test_stripe_log_truncate [gw0] [ 90%] PASSED test_logs_level/test.py::test_check_client_logs_level [gw4] [ 91%] PASSED test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists [gw3] [ 92%] PASSED test_keeper_nodes_move/test.py::test_node_move test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery [gw2] [ 93%] ERROR test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 [gw2] [ 94%] ERROR test_join_set_family_s3/test.py::test_set_s3 test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task [gw5] [ 95%] PASSED test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path [gw3] [ 96%] PASSED test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery [gw2] [ 97%] PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table [gw2] [ 98%] PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table [gw8] [ 99%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv [gw8] [100%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_to_mv ==================================== ERRORS ==================================== __________________ ERROR at setup of test_log_family_s3[Log] ___________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=["configs/storage_configuration.xml", "configs/ssl.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_log_family_s3/test.py:18: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... done E Pulling resolver ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling resolver ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:12:52 [ 504 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:12:52 [ 504 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:12:52 [ 504 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:12:52 [ 504 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:12:52 [ 504 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:12:52 [ 504 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:12:52 [ 504 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV HOSTNAME a299e206cf0b (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]' 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]' test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]' 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]' test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_file_schema_inference_cache/test.py::test 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]' 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]' test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio 'test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]' test_filesystem_cache/test.py::test_system_sync_filesystem_cache test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_http_native/test.py::test_http_native_returns_timezone test_intersecting_parts/test.py::test_intersect_parts_when_restart test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_log_family_s3/test.py::test_stripe_log_truncate test_logs_level/test.py::test_check_client_logs_level test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit test_merge_table_over_distributed/test.py::test_filtering test_merge_table_over_distributed/test.py::test_global_in test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists test_multi_access_storage_role_management/test.py::test_quotas test_multi_access_storage_role_management/test.py::test_role_from_different_storages test_multi_access_storage_role_management/test.py::test_roles test_multi_access_storage_role_management/test.py::test_settings_profiles test_multi_access_storage_role_management/test.py::test_users test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table -vvv (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV WORKER_FREE_PORTS 30300 30301 30302 30303 30304 30305 30306 30307 30308 30309 30310 30311 30312 30313 30314 30315 30316 30317 30318 30319 30320 30321 30322 30323 30324 30325 30326 30327 30328 30329 30330 30331 30332 30333 30334 30335 30336 30337 30338 30339 30340 30341 30342 30343 30344 30345 30346 30347 30348 30349 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID f86c87e8cc964c9392a0327f7facd02f (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV PYTEST_XDIST_WORKER gw6 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : ENV PYTEST_CURRENT_TEST test_log_family_s3/test.py::test_log_family_s3[Log] (setup) (cluster.py:446, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 16:12:52 [ 504 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:12:52 [ 504 ] DEBUG : Cluster name: project_name:roottestlogfamilys3_gw6. Added instance name:node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:12:52 [ 504 ] INFO : Starting cluster... (test.py:17, cluster) 2026-09-30 16:12:52 [ 504 ] INFO : Running tests in /ClickHouse/tests/integration/test_log_family_s3/test.py (cluster.py:2790, start) 2026-09-30 16:12:52 [ 504 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:12:52 [ 504 ] DEBUG : Docker networks for project roottestlogfamilys3_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:12:52 [ 504 ] DEBUG : Docker containers for project roottestlogfamilys3_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:12:52 [ 504 ] DEBUG : Docker volumes for project roottestlogfamilys3_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:12:52 [ 504 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:12:52 [ 504 ] DEBUG : Docker networks for project roottestlogfamilys3_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:12:52 [ 504 ] DEBUG : Docker containers for project roottestlogfamilys3_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:12:52 [ 504 ] DEBUG : Docker volumes for project roottestlogfamilys3_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:12:52 [ 504 ] DEBUG : Command:docker container list --all --filter name='^/roottestlogfamilys3_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:12:52 [ 504 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:12:52 [ 504 ] DEBUG : No running containers for project: roottestlogfamilys3_gw6 (cluster.py:904, cleanup) 2026-09-30 16:12:52 [ 504 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:12:52 [ 504 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:12:52 [ 504 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:12:53 [ 504 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:12:53 [ 504 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 16:12:53 [ 504 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:12:53 [ 504 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:12:53 [ 504 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:12:53 [ 504 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:12:53 [ 504 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_log_family_s3/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_log_family_s3/configs/ssl.xml'] to /ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:12:53 [ 504 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/database (cluster.py:4653, create_dir) 2026-09-30 16:12:53 [ 504 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/logs (cluster.py:4664, create_dir) 2026-09-30 16:12:53 [ 504 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:12:53 [ 504 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env (cluster.py:86, _create_env_file) 2026-09-30 16:12:53 [ 504 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:12:53 [ 504 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:12:53 [ 504 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:12:53 [ 504 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:12:53 [ 504 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:12:53 [ 504 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:13:55 [ 504 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:13:55 [ 504 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:13:57 [ 504 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 504 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:14:59 [ 504 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:15:01 [ 504 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 504 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:15:54 [ 504 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:15:57 [ 504 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 504 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:16:54 [ 504 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:16:58 [ 504 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:17:51 [ 504 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling resolver ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:17:51 [ 504 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:17:51 [ 504 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:17:51 [ 504 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:17:51 [ 504 ] DEBUG : Docker networks for project roottestlogfamilys3_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:17:51 [ 504 ] DEBUG : Docker containers for project roottestlogfamilys3_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:17:51 [ 504 ] DEBUG : Docker volumes for project roottestlogfamilys3_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:17:51 [ 504 ] DEBUG : Command:docker container list --all --filter name='^/roottestlogfamilys3_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:17:51 [ 504 ] DEBUG : No running containers for project: roottestlogfamilys3_gw6 (cluster.py:904, cleanup) 2026-09-30 16:17:51 [ 504 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:17:51 [ 504 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:17:51 [ 504 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stdout:6 (cluster.py:121, run_and_check) 2026-09-30 16:17:51 [ 504 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:17:51 [ 504 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:17:51 [ 504 ] DEBUG : Docker networks for project roottestlogfamilys3_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:17:51 [ 504 ] DEBUG : Docker containers for project roottestlogfamilys3_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:17:51 [ 504 ] DEBUG : Docker volumes for project roottestlogfamilys3_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:17:51 [ 504 ] DEBUG : Command:docker container list --all --filter name='^/roottestlogfamilys3_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:17:51 [ 504 ] DEBUG : No running containers for project: roottestlogfamilys3_gw6 (cluster.py:904, cleanup) 2026-09-30 16:17:51 [ 504 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:17:51 [ 504 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:17:51 [ 504 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:17:51 [ 504 ] DEBUG : Stdout:6 (cluster.py:121, run_and_check) _______________ ERROR at setup of test_log_family_s3[StripeLog] ________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=["configs/storage_configuration.xml", "configs/ssl.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_log_family_s3/test.py:18: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... done E Pulling resolver ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_log_family_s3[TinyLog] _________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=["configs/storage_configuration.xml", "configs/ssl.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_log_family_s3/test.py:18: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... done E Pulling resolver ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________________ ERROR at setup of test_stripe_log_truncate __________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=["configs/storage_configuration.xml", "configs/ssl.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_log_family_s3/test.py:18: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... done E Pulling resolver ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________________ ERROR at setup of test_join_s3 ________________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=["configs/minio.xml", "configs/ssl.xml"], with_minio=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_join_set_family_s3/test.py:19: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling node ... done E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling node ... done Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV HOSTNAME a299e206cf0b (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]' 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]' test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]' 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]' test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_file_schema_inference_cache/test.py::test 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]' 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]' test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio 'test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]' test_filesystem_cache/test.py::test_system_sync_filesystem_cache test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_http_native/test.py::test_http_native_returns_timezone test_intersecting_parts/test.py::test_intersect_parts_when_restart test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_log_family_s3/test.py::test_stripe_log_truncate test_logs_level/test.py::test_check_client_logs_level test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit test_merge_table_over_distributed/test.py::test_filtering test_merge_table_over_distributed/test.py::test_global_in test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists test_multi_access_storage_role_management/test.py::test_quotas test_multi_access_storage_role_management/test.py::test_role_from_different_storages test_multi_access_storage_role_management/test.py::test_roles test_multi_access_storage_role_management/test.py::test_settings_profiles test_multi_access_storage_role_management/test.py::test_users test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table -vvv (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV WORKER_FREE_PORTS 30100 30101 30102 30103 30104 30105 30106 30107 30108 30109 30110 30111 30112 30113 30114 30115 30116 30117 30118 30119 30120 30121 30122 30123 30124 30125 30126 30127 30128 30129 30130 30131 30132 30133 30134 30135 30136 30137 30138 30139 30140 30141 30142 30143 30144 30145 30146 30147 30148 30149 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID f86c87e8cc964c9392a0327f7facd02f (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV PYTEST_XDIST_WORKER gw2 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : ENV PYTEST_CURRENT_TEST test_join_set_family_s3/test.py::test_join_s3 (setup) (cluster.py:446, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 16:13:59 [ 477 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:13:59 [ 477 ] DEBUG : Cluster name: project_name:roottestjoinsetfamilys3_gw2. Added instance name:node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:13:59 [ 477 ] INFO : Starting cluster... (test.py:18, cluster) 2026-09-30 16:13:59 [ 477 ] INFO : Running tests in /ClickHouse/tests/integration/test_join_set_family_s3/test.py (cluster.py:2790, start) 2026-09-30 16:13:59 [ 477 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:13:59 [ 477 ] DEBUG : Docker networks for project roottestjoinsetfamilys3_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:13:59 [ 477 ] DEBUG : Docker containers for project roottestjoinsetfamilys3_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:13:59 [ 477 ] DEBUG : Docker volumes for project roottestjoinsetfamilys3_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:13:59 [ 477 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:13:59 [ 477 ] DEBUG : Docker networks for project roottestjoinsetfamilys3_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:13:59 [ 477 ] DEBUG : Docker containers for project roottestjoinsetfamilys3_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:13:59 [ 477 ] DEBUG : Docker volumes for project roottestjoinsetfamilys3_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:13:59 [ 477 ] DEBUG : Command:docker container list --all --filter name='^/roottestjoinsetfamilys3_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:13:59 [ 477 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:13:59 [ 477 ] DEBUG : No running containers for project: roottestjoinsetfamilys3_gw2 (cluster.py:904, cleanup) 2026-09-30 16:13:59 [ 477 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:14:00 [ 477 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:14:00 [ 477 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:14:00 [ 477 ] DEBUG : Stdout:4 (cluster.py:121, run_and_check) 2026-09-30 16:14:00 [ 477 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 16:14:00 [ 477 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:14:00 [ 477 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:14:00 [ 477 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:14:00 [ 477 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:14:00 [ 477 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_join_set_family_s3/configs/minio.xml', '/ClickHouse/tests/integration/test_join_set_family_s3/configs/ssl.xml'] to /ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:14:00 [ 477 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/database (cluster.py:4653, create_dir) 2026-09-30 16:14:00 [ 477 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/logs (cluster.py:4664, create_dir) 2026-09-30 16:14:00 [ 477 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:14:00 [ 477 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env (cluster.py:86, _create_env_file) 2026-09-30 16:14:00 [ 477 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:14:00 [ 477 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:14:00 [ 477 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:14:00 [ 477 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:14:00 [ 477 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:14:00 [ 477 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:14:59 [ 477 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:14:59 [ 477 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:15:01 [ 477 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:15:54 [ 477 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:15:54 [ 477 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... done Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:15:57 [ 477 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:16:54 [ 477 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:16:54 [ 477 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:16:57 [ 477 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:17:51 [ 477 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:17:51 [ 477 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:17:54 [ 477 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:18:54 [ 477 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling node ... done Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:18:54 [ 477 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:18:54 [ 477 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:18:54 [ 477 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:18:54 [ 477 ] DEBUG : Docker networks for project roottestjoinsetfamilys3_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:18:54 [ 477 ] DEBUG : Docker containers for project roottestjoinsetfamilys3_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:18:54 [ 477 ] DEBUG : Docker volumes for project roottestjoinsetfamilys3_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:18:54 [ 477 ] DEBUG : Command:docker container list --all --filter name='^/roottestjoinsetfamilys3_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:18:54 [ 477 ] DEBUG : No running containers for project: roottestjoinsetfamilys3_gw2 (cluster.py:904, cleanup) 2026-09-30 16:18:54 [ 477 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:18:54 [ 477 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:18:54 [ 477 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stdout:6 (cluster.py:121, run_and_check) 2026-09-30 16:18:54 [ 477 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:18:54 [ 477 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:18:54 [ 477 ] DEBUG : Docker networks for project roottestjoinsetfamilys3_gw2 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:18:54 [ 477 ] DEBUG : Docker containers for project roottestjoinsetfamilys3_gw2 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:18:54 [ 477 ] DEBUG : Docker volumes for project roottestjoinsetfamilys3_gw2 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:18:54 [ 477 ] DEBUG : Command:docker container list --all --filter name='^/roottestjoinsetfamilys3_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:18:54 [ 477 ] DEBUG : No running containers for project: roottestjoinsetfamilys3_gw2 (cluster.py:904, cleanup) 2026-09-30 16:18:54 [ 477 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:18:54 [ 477 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:18:54 [ 477 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:18:54 [ 477 ] DEBUG : Stdout:6 (cluster.py:121, run_and_check) ________________________ ERROR at setup of test_set_s3 _________________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=["configs/minio.xml", "configs/ssl.xml"], with_minio=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_join_set_family_s3/test.py:19: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling node ... done E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception =============================== warnings summary =============================== test_keeper_mntr_pressure/test.py::test_aggressive_mntr /usr/local/lib/python3.10/dist-packages/_pytest/threadexception.py:73: PytestUnhandledThreadExceptionWarning: Exception in thread Thread-83 () Traceback (most recent call last): File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner self.run() File "/usr/lib/python3.10/threading.py", line 953, in run self._target(*self._args, **self._kwargs) File "/ClickHouse/tests/integration/test_keeper_mntr_pressure/test.py", line 54, in node1_thread = threading.Thread(target=lambda: go_mntr(node1)) File "/ClickHouse/tests/integration/test_keeper_mntr_pressure/test.py", line 50, in go_mntr print(node.name, keeper_utils.send_4lw_cmd(cluster, node, "mntr")) File "/ClickHouse/tests/integration/helpers/keeper_utils.py", line 232, in send_4lw_cmd data = client.recv(100_000) ConnectionResetError: [Errno 104] Connection reset by peer warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg)) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ============================== slowest durations =============================== 299.09s setup test_log_family_s3/test.py::test_log_family_s3[Log] 295.05s setup test_join_set_family_s3/test.py::test_join_s3 272.62s call test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream 219.58s setup test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception 157.04s setup test_mask_sensitive_info/test.py::test_backup_table 65.01s setup test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] 62.49s setup test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path 61.74s setup test_keeper_client/test.py::test_base_commands 61.21s setup test_jbod_balancer/test.py::test_jbod_balanced_merge 59.25s setup test_keeper_back_to_back/test.py::test_concurrent_watches 58.88s setup test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command 58.83s setup test_keeper_four_word_command/test.py::test_cmd_clrs 57.68s setup test_keeper_mntr_pressure/test.py::test_aggressive_mntr 57.61s setup test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] 57.45s setup test_keeper_nodes_move/test.py::test_node_move 57.22s setup test_keeper_force_recovery_single_node/test.py::test_cluster_recovery 56.91s setup test_merge_table_over_distributed/test.py::test_filtering 56.74s setup test_multi_access_storage_role_management/test.py::test_quotas 55.41s call test_keeper_mntr_pressure/test.py::test_aggressive_mntr 55.38s call test_mask_sensitive_info/test.py::test_table_functions 55.33s setup test_intersecting_parts/test.py::test_intersect_parts_when_restart 55.08s setup test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery 54.88s call test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch 53.43s setup test_logs_level/test.py::test_check_client_logs_level 53.20s setup test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size 52.78s setup test_keeper_session/test.py::test_session_close_shutdown 50.43s setup test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists 50.42s setup test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant 50.22s setup test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task 48.84s setup test_file_schema_inference_cache/test.py::test 46.68s setup test_http_native/test.py::test_http_native_returns_timezone 45.04s call test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges 42.98s setup test_keeper_four_word_command/test_allow_list.py::test_allow_list 41.83s setup test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 41.66s call test_file_schema_inference_cache/test.py::test 41.05s setup test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 40.47s call test_keeper_nodes_move/test.py::test_node_move 39.13s call test_keeper_force_recovery_single_node/test.py::test_cluster_recovery 33.83s call test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command 29.43s call test_keeper_back_to_back/test.py::test_random_requests 28.09s call test_keeper_back_to_back/test.py::test_concurrent_watches 26.34s call test_mask_sensitive_info/test.py::test_create_table 23.67s call test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task 22.27s call test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table 21.32s call test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] 21.31s teardown test_kafka_bad_messages/test.py::test_bad_messages_to_mv 21.07s call test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size 19.64s call test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 17.60s call test_filesystem_cache/test.py::test_custom_cached_disk 16.62s call test_jbod_balancer/test.py::test_jbod_balanced_merge 16.14s call test_kafka_bad_messages/test.py::test_bad_messages_to_mv 13.22s call test_keeper_session/test.py::test_session_close_shutdown 12.90s teardown test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 12.18s call test_keeper_back_to_back/test.py::test_watchers 11.44s teardown test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command 11.38s call test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists 10.60s call test_memory_limit_observer/test.py::test_observe_memory_limit 9.73s call test_multi_access_storage_role_management/test.py::test_role_from_different_storages 8.53s teardown test_keeper_back_to_back/test.py::test_watchers 7.93s call test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path 7.40s call test_mask_sensitive_info/test.py::test_encryption_functions 7.14s call test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 6.69s teardown test_filesystem_cache/test.py::test_system_sync_filesystem_cache 6.43s call test_filesystem_cache/test.py::test_keep_up_size_ratio 6.10s teardown test_intersecting_parts/test.py::test_intersect_parts_when_restart 5.90s teardown test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed 5.77s teardown test_memory_limit_observer/test.py::test_observe_memory_limit 5.67s call test_multi_access_storage_role_management/test.py::test_quotas 5.61s teardown test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table 5.60s teardown test_mask_sensitive_info/test.py::test_table_functions 5.60s call test_multi_access_storage_role_management/test.py::test_users 5.40s call test_multi_access_storage_role_management/test.py::test_roles 5.40s call test_multi_access_storage_role_management/test.py::test_settings_profiles 5.22s call test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception 5.07s teardown test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] 4.96s teardown test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant 4.95s teardown test_http_native/test.py::test_http_native_returns_timezone 4.78s call test_mask_sensitive_info/test.py::test_backup_to_s3 4.75s call test_filesystem_cache/test.py::test_system_sync_filesystem_cache 4.30s teardown test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch 4.26s call test_mask_sensitive_info/test.py::test_create_alter_user 4.16s teardown test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 3.81s teardown test_keeper_mntr_pressure/test.py::test_aggressive_mntr 3.78s call test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] 3.61s call test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] 3.60s call test_mask_sensitive_info/test.py::test_table_function_ways_to_call 3.53s teardown test_keeper_client/test.py::test_set_without_version 3.43s call test_mask_sensitive_info/test.py::test_create_database 3.40s teardown test_logs_level/test.py::test_check_client_logs_level 3.38s call test_intersecting_parts/test.py::test_intersect_parts_when_restart 3.32s teardown test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists 3.27s teardown test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path 3.14s call test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery 3.14s teardown test_keeper_session/test.py::test_session_timeout 3.13s call test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] 2.68s teardown test_keeper_four_word_command/test.py::test_cmd_ydld 2.66s call test_mask_sensitive_info/test.py::test_create_dictionary 2.65s teardown test_file_schema_inference_cache/test.py::test 2.64s call test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant 2.53s call test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] 2.47s teardown test_multi_access_storage_role_management/test.py::test_users 2.47s teardown test_keeper_nodes_move/test.py::test_node_move 2.47s call test_mask_sensitive_info/test.py::test_on_cluster 2.45s teardown test_keeper_four_word_command/test_allow_list.py::test_allow_list 2.36s teardown test_keeper_force_recovery_single_node/test.py::test_cluster_recovery 2.19s call test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 2.11s teardown test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery 1.62s call test_keeper_four_word_command/test_allow_list.py::test_allow_list 1.55s call test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] 1.28s call test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] 1.24s call test_mask_sensitive_info/test.py::test_backup_table 1.06s call test_keeper_four_word_command/test.py::test_cmd_ydld 1.04s call test_keeper_four_word_command/test.py::test_cmd_rqld 0.96s call test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed 0.85s call test_merge_table_over_distributed/test.py::test_filtering 0.84s call test_keeper_four_word_command/test.py::test_cmd_mntr 0.72s call test_keeper_four_word_command/test.py::test_cmd_lgif 0.69s call test_keeper_back_to_back/test.py::test_stats 0.68s call test_merge_table_over_distributed/test.py::test_global_in 0.64s call test_keeper_back_to_back/test.py::test_end_of_watches_session 0.37s call test_keeper_four_word_command/test.py::test_cmd_wchc 0.33s call test_keeper_four_word_command/test.py::test_cmd_wchp 0.33s call test_keeper_four_word_command/test.py::test_cmd_crst 0.32s call test_keeper_four_word_command/test.py::test_cmd_cons 0.32s call test_keeper_four_word_command/test.py::test_cmd_stat 0.31s call test_keeper_four_word_command/test.py::test_cmd_dump 0.31s call test_keeper_four_word_command/test.py::test_cmd_srvr 0.30s call test_keeper_back_to_back/test.py::test_end_of_session 0.26s call test_keeper_four_word_command/test.py::test_cmd_wchs 0.26s call test_keeper_back_to_back/test.py::test_sequential_nodes 0.22s call test_logs_level/test.py::test_check_client_logs_level 0.22s call test_keeper_four_word_command/test.py::test_cmd_clrs 0.16s call test_keeper_four_word_command/test.py::test_cmd_srst 0.14s call test_keeper_back_to_back/test.py::test_simple_commands 0.13s call test_keeper_back_to_back/test.py::test_multitransactions 0.12s call test_keeper_four_word_command/test.py::test_cmd_conf 0.10s call test_keeper_four_word_command/test.py::test_cmd_csnp 0.10s setup test_keeper_client/test.py::test_quoted_argument_parsing 0.09s setup test_keeper_client/test.py::test_set_without_version 0.09s setup test_keeper_client/test.py::test_find_super_nodes 0.09s setup test_keeper_client/test.py::test_four_letter_word_commands 0.09s setup test_keeper_client/test.py::test_delete_stale_backups 0.09s setup test_keeper_client/test.py::test_big_family 0.08s setup test_keeper_client/test.py::test_rm_with_version 0.08s setup test_keeper_client/test.py::test_rm_without_version 0.08s setup test_keeper_client/test.py::test_get_all_children_number 0.08s setup test_keeper_client/test.py::test_set_with_version 0.07s teardown test_keeper_client/test.py::test_get_all_children_number 0.07s teardown test_keeper_client/test.py::test_delete_stale_backups 0.07s teardown test_keeper_client/test.py::test_base_commands 0.07s teardown test_keeper_client/test.py::test_four_letter_word_commands 0.06s teardown test_keeper_client/test.py::test_quoted_argument_parsing 0.06s teardown test_keeper_client/test.py::test_big_family 0.06s call test_http_native/test.py::test_http_native_returns_timezone 0.05s teardown test_keeper_client/test.py::test_rm_with_version 0.05s teardown test_keeper_client/test.py::test_rm_without_version 0.05s teardown test_keeper_client/test.py::test_find_super_nodes 0.05s teardown test_keeper_client/test.py::test_set_with_version 0.04s call test_keeper_client/test.py::test_delete_stale_backups 0.04s call test_keeper_client/test.py::test_find_super_nodes 0.04s call test_keeper_client/test.py::test_get_all_children_number 0.04s call test_keeper_client/test.py::test_big_family 0.03s call test_keeper_session/test.py::test_session_timeout 0.03s teardown test_keeper_back_to_back/test.py::test_random_requests 0.02s call test_keeper_four_word_command/test.py::test_cmd_isro 0.02s call test_keeper_client/test.py::test_quoted_argument_parsing 0.02s call test_keeper_client/test.py::test_set_with_version 0.02s call test_keeper_client/test.py::test_rm_with_version 0.01s call test_keeper_client/test.py::test_base_commands 0.01s call test_keeper_four_word_command/test.py::test_cmd_ruok 0.01s teardown test_keeper_back_to_back/test.py::test_concurrent_watches 0.01s call test_keeper_client/test.py::test_set_without_version 0.01s call test_keeper_client/test.py::test_rm_without_version 0.00s teardown test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream 0.00s call test_keeper_client/test.py::test_four_letter_word_commands 0.00s teardown test_jbod_balancer/test.py::test_jbod_balanced_merge 0.00s teardown test_keeper_back_to_back/test.py::test_stats 0.00s setup test_keeper_back_to_back/test.py::test_stats 0.00s setup test_keeper_back_to_back/test.py::test_simple_commands 0.00s setup test_multi_access_storage_role_management/test.py::test_users 0.00s teardown test_mask_sensitive_info/test.py::test_create_table 0.00s setup test_merge_table_over_distributed/test.py::test_global_in 0.00s setup test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch 0.00s setup test_mask_sensitive_info/test.py::test_encryption_functions 0.00s teardown test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception 0.00s teardown test_mask_sensitive_info/test.py::test_backup_table 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_mntr 0.00s setup test_mask_sensitive_info/test.py::test_create_dictionary 0.00s setup test_keeper_four_word_command/test.py::test_cmd_conf 0.00s teardown test_merge_table_over_distributed/test.py::test_filtering 0.00s teardown test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] 0.00s setup test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] 0.00s setup test_mask_sensitive_info/test.py::test_create_alter_user 0.00s setup test_keeper_back_to_back/test.py::test_watchers 0.00s setup test_keeper_four_word_command/test.py::test_cmd_cons 0.00s setup test_keeper_back_to_back/test.py::test_random_requests 0.00s setup test_filesystem_cache/test.py::test_system_sync_filesystem_cache 0.00s setup test_mask_sensitive_info/test.py::test_backup_to_s3 0.00s setup test_keeper_four_word_command/test.py::test_cmd_wchp 0.00s setup test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges 0.00s teardown test_keeper_back_to_back/test.py::test_simple_commands 0.00s setup test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] 0.00s setup test_keeper_session/test.py::test_session_timeout 0.00s teardown test_keeper_back_to_back/test.py::test_sequential_nodes 0.00s setup test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] 0.00s setup test_mask_sensitive_info/test.py::test_on_cluster 0.00s setup test_keeper_back_to_back/test.py::test_sequential_nodes 0.00s setup test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] 0.00s setup test_multi_access_storage_role_management/test.py::test_settings_profiles 0.00s setup test_mask_sensitive_info/test.py::test_create_table 0.00s setup test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 0.00s teardown test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] 0.00s setup test_multi_access_storage_role_management/test.py::test_role_from_different_storages 0.00s setup test_mask_sensitive_info/test.py::test_create_database 0.00s setup test_filesystem_cache/test.py::test_custom_cached_disk 0.00s teardown test_mask_sensitive_info/test.py::test_create_database 0.00s setup test_kafka_bad_messages/test.py::test_bad_messages_to_mv 0.00s teardown test_keeper_back_to_back/test.py::test_multitransactions 0.00s setup test_keeper_four_word_command/test.py::test_cmd_rqld 0.00s teardown test_keeper_back_to_back/test.py::test_end_of_watches_session 0.00s setup test_filesystem_cache/test.py::test_keep_up_size_ratio 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_conf 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_clrs 0.00s teardown test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task 0.00s setup test_keeper_four_word_command/test.py::test_cmd_isro 0.00s teardown test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] 0.00s teardown test_multi_access_storage_role_management/test.py::test_quotas 0.00s setup test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table 0.00s setup test_keeper_back_to_back/test.py::test_end_of_watches_session 0.00s teardown test_keeper_back_to_back/test.py::test_end_of_session 0.00s setup test_mask_sensitive_info/test.py::test_table_functions 0.00s teardown test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] 0.00s teardown test_filesystem_cache/test.py::test_custom_cached_disk 0.00s teardown test_mask_sensitive_info/test.py::test_encryption_functions 0.00s teardown test_mask_sensitive_info/test.py::test_create_alter_user 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_cons 0.00s teardown test_mask_sensitive_info/test.py::test_table_function_ways_to_call 0.00s setup test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_wchc 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_dump 0.00s teardown test_mask_sensitive_info/test.py::test_create_dictionary 0.00s setup test_keeper_four_word_command/test.py::test_cmd_dump 0.00s teardown test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] 0.00s teardown test_log_family_s3/test.py::test_stripe_log_truncate 0.00s setup test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed 0.00s teardown test_multi_access_storage_role_management/test.py::test_settings_profiles 0.00s teardown test_log_family_s3/test.py::test_log_family_s3[Log] 0.00s teardown test_mask_sensitive_info/test.py::test_backup_to_s3 0.00s teardown test_join_set_family_s3/test.py::test_join_s3 0.00s setup test_keeper_four_word_command/test.py::test_cmd_wchs 0.00s setup test_memory_limit_observer/test.py::test_observe_memory_limit 0.00s setup test_keeper_back_to_back/test.py::test_end_of_session 0.00s teardown test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] 0.00s setup test_keeper_four_word_command/test.py::test_cmd_csnp 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_wchp 0.00s setup test_keeper_four_word_command/test.py::test_cmd_lgif 0.00s teardown test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size 0.00s setup test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_crst 0.00s setup test_keeper_four_word_command/test.py::test_cmd_srst 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_csnp 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_lgif 0.00s teardown test_log_family_s3/test.py::test_log_family_s3[StripeLog] 0.00s teardown test_keeper_session/test.py::test_session_close_shutdown 0.00s teardown test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 0.00s teardown test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges 0.00s teardown test_merge_table_over_distributed/test.py::test_global_in 0.00s teardown test_join_set_family_s3/test.py::test_set_s3 0.00s setup test_mask_sensitive_info/test.py::test_table_function_ways_to_call 0.00s teardown test_log_family_s3/test.py::test_log_family_s3[TinyLog] 0.00s setup test_log_family_s3/test.py::test_log_family_s3[TinyLog] 0.00s setup test_multi_access_storage_role_management/test.py::test_roles 0.00s teardown test_multi_access_storage_role_management/test.py::test_roles 0.00s teardown test_multi_access_storage_role_management/test.py::test_role_from_different_storages 0.00s setup test_keeper_four_word_command/test.py::test_cmd_mntr 0.00s setup test_join_set_family_s3/test.py::test_set_s3 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_srst 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_ruok 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_isro 0.00s setup test_keeper_four_word_command/test.py::test_cmd_ydld 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_wchs 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_stat 0.00s setup test_keeper_four_word_command/test.py::test_cmd_wchc 0.00s setup test_log_family_s3/test.py::test_stripe_log_truncate 0.00s teardown test_filesystem_cache/test.py::test_keep_up_size_ratio 0.00s setup test_keeper_four_word_command/test.py::test_cmd_crst 0.00s teardown test_mask_sensitive_info/test.py::test_on_cluster 0.00s setup test_keeper_four_word_command/test.py::test_cmd_stat 0.00s setup test_keeper_four_word_command/test.py::test_cmd_srvr 0.00s setup test_keeper_four_word_command/test.py::test_cmd_ruok 0.00s setup test_keeper_back_to_back/test.py::test_multitransactions 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_srvr 0.00s setup test_log_family_s3/test.py::test_log_family_s3[StripeLog] 0.00s teardown test_keeper_four_word_command/test.py::test_cmd_rqld =========================== short test summary info ============================ ERROR test_log_family_s3/test.py::test_log_family_s3[Log] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_log_family_s3/test.py::test_log_family_s3[StripeLog] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_log_family_s3/test.py::test_log_family_s3[TinyLog] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_log_family_s3/test.py::test_stripe_log_truncate - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/.env', '--project-name', 'roottestlogfamilys3_gw6', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_join_set_family_s3/test.py::test_join_s3 - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_join_set_family_s3/test.py::test_set_s3 - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... PASSED test_merge_table_over_distributed/test.py::test_filtering PASSED test_merge_table_over_distributed/test.py::test_global_in PASSED test_keeper_four_word_command/test.py::test_cmd_clrs PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] PASSED test_keeper_four_word_command/test.py::test_cmd_conf PASSED test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed PASSED test_keeper_four_word_command/test.py::test_cmd_cons PASSED test_keeper_four_word_command/test.py::test_cmd_crst PASSED test_keeper_four_word_command/test.py::test_cmd_csnp PASSED test_keeper_four_word_command/test.py::test_cmd_dump PASSED test_keeper_four_word_command/test.py::test_cmd_isro PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] PASSED test_keeper_four_word_command/test.py::test_cmd_lgif PASSED test_keeper_client/test.py::test_base_commands PASSED test_keeper_four_word_command/test.py::test_cmd_mntr PASSED test_keeper_client/test.py::test_big_family PASSED test_keeper_client/test.py::test_delete_stale_backups PASSED test_keeper_client/test.py::test_find_super_nodes PASSED test_multi_access_storage_role_management/test.py::test_quotas PASSED test_keeper_client/test.py::test_four_letter_word_commands PASSED test_keeper_client/test.py::test_get_all_children_number PASSED test_keeper_client/test.py::test_quoted_argument_parsing PASSED test_keeper_four_word_command/test.py::test_cmd_rqld PASSED test_keeper_four_word_command/test.py::test_cmd_ruok PASSED test_keeper_client/test.py::test_rm_with_version PASSED test_keeper_four_word_command/test.py::test_cmd_srst PASSED test_keeper_client/test.py::test_rm_without_version PASSED test_keeper_client/test.py::test_set_with_version PASSED test_keeper_four_word_command/test.py::test_cmd_srvr PASSED test_keeper_client/test.py::test_set_without_version PASSED test_keeper_four_word_command/test.py::test_cmd_stat PASSED test_keeper_four_word_command/test.py::test_cmd_wchc PASSED test_keeper_four_word_command/test.py::test_cmd_wchp PASSED test_keeper_four_word_command/test.py::test_cmd_wchs PASSED test_keeper_four_word_command/test.py::test_cmd_ydld PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] PASSED test_multi_access_storage_role_management/test.py::test_role_from_different_storages PASSED test_multi_access_storage_role_management/test.py::test_roles PASSED test_filesystem_cache/test.py::test_custom_cached_disk PASSED test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] PASSED test_multi_access_storage_role_management/test.py::test_settings_profiles PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] PASSED test_keeper_back_to_back/test.py::test_concurrent_watches PASSED test_keeper_back_to_back/test.py::test_end_of_session PASSED test_keeper_back_to_back/test.py::test_end_of_watches_session PASSED test_keeper_back_to_back/test.py::test_multitransactions PASSED test_multi_access_storage_role_management/test.py::test_users PASSED test_keeper_back_to_back/test.py::test_random_requests PASSED test_keeper_back_to_back/test.py::test_sequential_nodes PASSED test_keeper_back_to_back/test.py::test_simple_commands PASSED test_keeper_back_to_back/test.py::test_stats PASSED test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges PASSED test_filesystem_cache/test.py::test_keep_up_size_ratio PASSED test_keeper_back_to_back/test.py::test_watchers PASSED test_keeper_session/test.py::test_session_close_shutdown PASSED test_keeper_session/test.py::test_session_timeout PASSED test_jbod_balancer/test.py::test_jbod_balanced_merge PASSED test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant PASSED test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] PASSED test_filesystem_cache/test.py::test_system_sync_filesystem_cache PASSED test_mask_sensitive_info/test.py::test_backup_table PASSED test_mask_sensitive_info/test.py::test_backup_to_s3 PASSED test_mask_sensitive_info/test.py::test_create_alter_user PASSED test_mask_sensitive_info/test.py::test_create_database PASSED test_mask_sensitive_info/test.py::test_create_dictionary PASSED test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts PASSED test_file_schema_inference_cache/test.py::test PASSED test_http_native/test.py::test_http_native_returns_timezone PASSED test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch PASSED test_mask_sensitive_info/test.py::test_create_table PASSED test_mask_sensitive_info/test.py::test_encryption_functions PASSED test_mask_sensitive_info/test.py::test_on_cluster PASSED test_mask_sensitive_info/test.py::test_table_function_ways_to_call PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception PASSED test_intersecting_parts/test.py::test_intersect_parts_when_restart PASSED test_keeper_mntr_pressure/test.py::test_aggressive_mntr PASSED test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command PASSED test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit PASSED test_mask_sensitive_info/test.py::test_table_functions PASSED test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size PASSED test_memory_limit_observer/test.py::test_observe_memory_limit PASSED test_keeper_four_word_command/test_allow_list.py::test_allow_list PASSED test_keeper_force_recovery_single_node/test.py::test_cluster_recovery PASSED test_logs_level/test.py::test_check_client_logs_level PASSED test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists PASSED test_keeper_nodes_move/test.py::test_node_move PASSED test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path PASSED test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream PASSED test_kafka_bad_messages/test.py::test_bad_messages_to_mv ============= 94 passed, 1 warning, 6 errors in 536.65s (0:08:56) ============== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_ij56yx --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]' 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]' test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]' 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]' test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_file_schema_inference_cache/test.py::test 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]' 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]' test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio 'test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]' test_filesystem_cache/test.py::test_system_sync_filesystem_cache test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_http_native/test.py::test_http_native_returns_timezone test_intersecting_parts/test.py::test_intersect_parts_when_restart test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_log_family_s3/test.py::test_stripe_log_truncate test_logs_level/test.py::test_check_client_logs_level test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit test_merge_table_over_distributed/test.py::test_filtering test_merge_table_over_distributed/test.py::test_global_in test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists test_multi_access_storage_role_management/test.py::test_quotas test_multi_access_storage_role_management/test.py::test_role_from_different_storages test_multi_access_storage_role_management/test.py::test_roles test_multi_access_storage_role_management/test.py::test_settings_profiles test_multi_access_storage_role_management/test.py::test_users test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table -vvv" altinityinfra/integration-tests-runner:cf95077f4609 ' returned non-zero exit status 1.